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ABSTRACT 

Title I students remain among the most challenging population for achieving significant gains in 
academic performance and standardized test scores. This multi-state, quasi-experimental, pre- 
versus-post study reflects the comparative Title I gains for math and reading scores for teachers 
participating in an online, on-demand professional development program school-wide versus non¬ 
participating Title I in their respective districts as benchmarks. Average Title I gains in reading 
were 4.8% (p<.001) versus 0.1%) (ns) in the non-participating Title I schools. For math scores, 
non-participating Title I schools in the districts saw a decline of 5.9% (p<.001), while Title I 
schools participating in the professional development experienced a gain of 7.3%o (p<.001). 
Conclusions are that significant advantages for Title I students are achieved when teachers 
participate actively in such a high impact, high accessibility professional development program. 
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INTRODUCTION 



itle 1 schools are described as “low income” and “disadvantaged” schools (Kirby, 2003; U.S. Dept, of 
Education, 2001). Within them are found a large proportions of students suffering from low 
achievement, described generally as being unprepared to advance in grade levels (Hung, 2011; Kirby, 
2003; U.S. Dept, of Education, 2001). Title I schools have recently been targeted for improvements by mandated 
interventions that have been shown in research to be highly speculative, minimally effective, and overly restrictive 
(Waddell 2011). Meeting the imperative for improved accountability toward increasing performance for 
disadvantaged, Title I students will require programs and interventions beyond those shown to fail in the past, 
solutions that have been proven through research to achieve beneficial, substantive achievement gains (United States 
General Accounting Office, 2000). 


Despite the emergent need, solutions for increasing achievement among students in Title I schools must 
represent cost-effective, highly scalable approaches that can reach large numbers of students with high efficacy. To 
scale in meeting the needs of so many students, best programs, therefore, will need to rely upon training teachers to 
be more effective, raising their impactfulness and thereby the score for their students. For this reason, there is an 
ever-increasing imperative to increase the impactfulness of professional development (PD) programs offered to 
educators, especially those in the role of teacher. Perhaps the only hope of reaching the many students in Title I 
settings is to first reach their teachers. 


Historically, PD programs have relied primarily on seminar-like experiences for teachers (Borko, 2004 ; 
Clarke & Hollingsworth, 2002). However, requiring or enabling teachers to spend extensive time away from the 
classroom is costly to educational systems and disruptive to the norms of day-to-day classroom management. 
Seminars necessitate replacement teachers at additional expense, and these generally are unacquainted with the 
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students or their needs, collectively as classroom group or individually. For these intuitive reasons, therefore, it is 
increasingly mission-critical that PD programs and offerings be implemented cost-effectively, while still reflecting 
proven success for helping teachers impact student achievement (c.f. Buczynski and Hansen 2010; Avalos 2011; 
Garet et al. 2001; Desimone et al. 2002; Shaha et al. 2004; Meiers and Ingvarson 2005; Wasik and Hindman 2011). 
The driving data should substantiate that this more cost-effective and less disruptive approach is not solely cheaper, 
but that it results in better impacts for student performance as the highest driving goal. 

Online, on-demand programs offer just such an efficient, cost-effective alternative to traditional seminar¬ 
like approaches. Such programs enable teachers to attend without compromising their ability to still support their 
teaching load. Additionally such programs, when well designed and delivered, also enable teachers to participate in 
modules that either leaders determine are most needed for them collectively or individually, whether aimed as 
scholastic subjects for improved teaching skills, or other areas for continuous personal improvement. And teachers 
can be self-guided, of course, and select areas of personal interest or desired personal growth regarding which they 
desire the greatest instruction. 

More importantly, Internet-based, online, on-demand programs have recently been proven effective in 
rigorous research. One study reflected data from 39 states and quantified comparative gains in standardized 
assessments performance for schools participating in Internet-based, online, on-demand programs versus their own 
respective districts as benchmarks (Shaha and Ellsworth, 2013). Results showed significant advantages in both math 
and reading performance, from 15% to 18%, for schools whose teachers actively participated in the Internet-based, 
on-demand PD versus their respective districts, the latter gaining only 2% to 4% in the same period. Equally 
important, those gains achieved were not haphazard, but were sustained into the next year (Shaha, Glassett & Copas 
2015a). Another recent multi-state study showed that successes from the same PD approach resulted in gains still 
sustained seven years through continued PD participation (Shaha, Glassett & Copas 2015b). 

Those studies reviewed reflect the impacts of this broad accessible, high impact, low cost approach to 
professional development on schools within a variety of states and socio-economic characteristics (Shaha & 
Ellsworth 2014). However, a review of the literature has provided no such research nor proven PD approaches that 
address the needs of Title I schools and their students (Hung, 2011). Arguably it is Title I settings that most need 
the additional lift form impactful teacher PD, yet no such data could be found. We determined this to be an 
unjustifiable travesty, and so undertook the research ourselves (Wolf & Jacob, 2013). 

The research question for the present study focused on whether significant and beneficial impacts for 
online, on-demand, readily-accessible professional development would have significantly beneficial impacts for 
students, through their teachers, within Title I schools. 

METHODS 

A quasi-experimental study design was undertaken to contrast the teachers in Title I schools (Title I User- 
schools) participating in an online-delivered professional development (PD) as the “treatment group” with their 
respective Title I Districts that did not use the professional learning tool as the “control group.” Inclusion in the PD 
participation Title I User-schools was limited to schools with use of the commercially-delivered PD offering (PD 
360 ® and Observation 360 ®, School Improvement Network, Salt Lake City) at a minimum of 90 percent of 
teachers at a minimum mean of 90 minutes per teacher (Shaha & Ellsworth, 2013). The PD offering is best defined 
as an on-demand, Internet-accessible product suite through which educators can participate in capabilities ranging 
from viewing instructional videos on teaching techniques, including participation in communities and posting and 
downloading PD-related materials from other PD users. 

Title I User-schools included in the “treatment group” were identified from data automatically captured 
through use of the Internet-based PD offering, as provided by the PD provider (School Improvement Network), and 
confirmed as Title I through publically available, Internet accessed data sources. Title I District included in the 
“control group” were limited to those to which each User-school belonged. All Title I User-schools and Title I 
Districts then reached final inclusion only when Title I User-schools constituted one-half or fewer of all schools 
within their Title I District. This final filter ensured that “treatment versus control” would represent socio- 
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economically and educator-resource comparable quasi-experimental groups, and no Title I District’s quantified 
performance would represent any overwhelming bias from too large a representation of Title I User-schools. 

The final sample included 422 Title I User-schools within 111 Title I Districts, representing 26 of the 
United States. Student performance data were then added for each Title I User-schools and Title I Districts, 
gathered from publically available web sources for the two consecutive school years, 2010-2011 and 2011-2012. 
When not available online, performance data were gathered from district-supplied Excel spreadsheets as requested 
with Institutional Review Board (IRB) approval where IRB relationships existed. Performance data analyzed were 
defined as the sum of the percentages of students rated either proficient or advanced, for math and reading, 
reflecting whatever standardized test was in use, thus performance data were normalized for differences between 
assessment tools by setting (Shaha & Ellsworth 2013). All analyses were conducted using SPSS version 17.0 or 
higher (PASW Statistics, SPSS, 2009, with SAS used for confirmatory purposes when results were close to p<0.05). 

RESULTS 

Student performance levels showed consistent and statistically significant advantages favoring Title I User- 
schools with the professional learning tools versus their respective and otherwise-equal Title I Districts. Title I 
User-schools whose teachers participated in PD significantly outperformed their respective districts in student 
performance in both reading and mathematics. Moreover, improvements observed in Title I Districts implied that 
gains made were likely boosted for each entire district as a reflection of Title I User-schools gains nested within the 
district-comprehensive averages. 

Reading 


Title I User-schools demonstrated statistically significant year-over-year increases in reading as reflecting 
in the combined percent of students categorized as proficient and advanced on annual standardized tests. While 
minimal mean gains of 0.1% were experienced across districts, the Title I User-schools gained an average of 4.8% 
year-over-year, a performance advantage 4.6% better (p<.001) (see figures 1 and 2). Further, the second year data 
indicated that PC participation for Title I User-schools was correlated with a newly evidenced performance gap 
where none existed prior to the PD use. 
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Figure 1 . Comparative change in reading performance 
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Figure 2. Percent change in reading performance 
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Mathematics 

As with reading, the Title I User-schools experienced significant greater gains in mathematic proficiency 
above those experienced by their matched Title I Districts collectively (p<.001). Unlike with Reading, results in 
mathematics showed that the districts cumulatively saw a decline of 5.9% of students scoring proficient or 
advanced, while the participating Title I User-schools within those same districts experienced a gain of 7.3% for the 
same time period. The year-over-year growth advantage was 13.2% (p<.001) favoring of the Title I User-schools 
(see figure 3 and 4). Thus even the improvements experienced in Title I User-schools was insufficient to raise 
performance for the Title I Districts within which they were imbedded. 
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Figure 3. Comparative gains in math performance 
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CONCLUSION 

To our knowledge, no multi-state, large sample study has successfully documented significant advantages 
in teacher professional development for Title I schools. In this unique, multi-state study, students of teachers in 
Title I schools that participated in the online, on-demand, Internet-delivered professional development studied 
experienced significantly higher end scores and year-to-year growth than did their peers within the same districts 
whose schools did not have teacher participation. The advantage of participation was verified for both reading 
performance and mathematics performance in terms of significantly better end states and year-to-year increases in 
the proportion of students classified as proficient or advanced on standardized tests. The pattern documented 
reflected the mean performance levels for over 200 participating schools collectively versus their 111 districts within 
26 states. 
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The goal of educators and educational institutions, particularly Title I schools, is to lift students to their 
highest possible levels of academic accomplishment. Historically, gaining significant score growth within Title I 
schools has been challenging, even when efforts were focused on populations within single schools, or single 
districts, or single states. To have documented such significant impact across such a large and comprehensive 
sample is not only noteworthy, but substantive enough to merit attention at policy-making levels. These data show 
that teachers, when provided with substantive and readily-accessible materials for enhancing their skills and 
capabilities, apparently have greater and more substantive impact on their students. 

Title I students have been justifiably categorized as “disadvantaged” for a list of reasons. However, these 
data raise the question whether advantages can be achieved for these students when teachers are equipped with 
sztate-of-the-art Internet-delivered professional development. While contrasts of impacts versus non-Title I schools 
and students was not included in this study, previous research has left little doubt that these gains were both 
predictable, and likely equal to or greater than those found within non-Title I settings. 

These data leave little argument that online, on-demand professional development merits broader utilization 
and evaluation throughout the variety of school settings within which teacher continue to effort selflessly to help 
their students grow and maximize their potentials. These findings establish a data-driven recommendation that this 
approach is worthy of strong consideration. The focus on educational settings focused on meeting the needs of 
“disadvantaged” students, as reflected in this study, is both timely and appropriate, and the findings leave little doubt 
regarding this student-focused investment. Whether other PD approaches might have achieved similar or equal 
results remains untested and, from the literature, doubtful. 
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